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Question 5 


Intent of Question 





The primary goals of this statistical inference question were to assess a student’s ability to (1) interpret a 
p-value in context; (2) make an appropriate conclusion about the study based on the p-value: and (3) based 
on the conclusion, identify the type of error that could have occurred and a possible consequence of this 
error in context. 


Solution 
Part (a): 


The p-value of 0.0761 measures the chance of observing a difference between the two sample 
proportions ( Peo - Pesan) as large as or larger than the one observed, if the survival rates for the two 
treatments (CC alone and CC + MMR) are in fact the same. 


Part (b): 
Because the p-value of 0.0761 is greater than 0.05, the null hypothesis should not be rejected. That is, 


there is not sufficient evidence to conclude that the treatment “CC alone” produces a higher survival 
rate than the standard treatment “CC + MMR.” 


Part (c): 
Because the null hypothesis was not rejected, a Type II error could have occurred. A possible 


consequence is that CC + MMR would continue as the accepted practice when, in fact, CC alone 
would result in a higher survival rate. 


Scoring 


Parts (a), (b), and (c) are scored as essentially correct (E), partially correct (P), or incorrect (I). 
Part (a) is scored as follows: 


A correct interpretation must include the following three components: 

e Correct probability phrase (e.g., “The p-value of 0.0761 measures the chance of . . .”) that includes 
the words “as large as” (or something similar). 

e Correct conditional phrase (e.g., “if the survival rates for the two treatments are in fact the same”). 

e Correct context. 


Essentially correct (E) if the response includes all three components. 

Partially correct (P) if the response includes the first component and one of the other two components 
OR 

if the probability phrase is complete except for the omission of the words “as large as” (or something 


similar) and the other two components are included. 


Incorrect (I) if the response includes no more than one component. 
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Question 5 (continued) 
Part (b) is scored as follows: 


Essentially correct (E) if a correct conclusion (failure to reject Ho) is provided in context with 
appropriate linkage to the p-value. 


Partially correct (P) if a correct conclusion is provided but either the context or linkage is missing 
OR 
the student “accepts Ho” (or something similar) and provides both context and linkage. 


Incorrect (I) if the student rejects Ho 
OR 
the student provides neither context nor linkage. 


Part (c) is scored as follows: 


A correct response must include the following two components: 

e The type of error named is consistent with the conclusion in part (b). 

e Aconsequence is provided (in context) that is consistent with the conclusion in part (b) and is 
specific with regard to the treatments. The consequence must address how heart attack patients 
will be treated as a result of the error. 


Essentially correct (E) if the response includes both components. 
Partially correct (P) if the response includes only the consequence component 
OR 
the type of error named is consistent with the conclusion in part (b) AND a correct definition (either 
generic or in context) of that error is given, but the consequence component is either missing or 


incorrect. 


Incorrect (I) if the response does not include the consequence component, apart from the exception 
given above as the second type of a partially correct response. 


4 Complete Response 
All three parts essentially correct 
3 Substantial Response 
Two parts essentially correct and one part partially correct 
2 Developing Response 
Two parts essentially correct and no part partially correct 
OR 
One part essentially correct and one or two parts partially correct 


OR 
Three parts partially correct 
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Question 5 (continued) 
Minimal Response 
One part essentially correct and no parts partially correct 


OR 
No parts essentially correct and two parts partially correct 
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5. For many years, the medically accepted practice of giving aid to a person experiencing a heart attack was to have 
the person who placed the emergency call administer chest compression (CC) plus standard mouth-to-mouth 
resuscitation (MMR) to the heart attack patient until the emergency response team arrived. However, some 
researchers believed that CC alone would be a more effective approach. 


In the 1990s a study was conducted in Seattle in which 518 cases were randomly assigned to treatments: 278 to 
CC plus standard MMR and 240 to CC alone. A total of 64 patients survived the heart attack: 29 in the group 
receiving CC plus standard MMR, and 35 in the group receiving CC alone. A test of significance was conducted 
on the following hypotheses. 


Hp: The survival rates for the two treatments are equal. 


H,: The treatment that uses CC alone produces a higher survival rate. 
This test resulted in a p-value of 0.0761. 


(a) Interpret what this p-value measures in the context of this study. 
Tr Xhis Sdn, ne eaobalal iy of dycenina data 3S 
Qhrenne ao Whet Was Collected assum, he sun 
RS Coo yg bu breaks are equa) \S tI, 


(b) Based on this p-value and study design, what conclusion should be drawn in the context of this study? Use a 
significance level of a = 0.05. 


WW A= DS QNavt vi. ks a ona ig ull upottais 
So Ove weed We doko Vanes the tralian 
nok vSes CL alore GALLS @ Wider SyVNal Vake , 


GO ON TO THE NEXT PAGE. 
-12- 
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If you need more room for your work for part (b), use the space below. 


(c) Based on your conclusion in part (b), which type of error, Type I or Type I, could have been made? What is 
one potential consequence of this error? 


; we DEAN Wade, Ww WOW Hare, 
ee pte a cSt jected. ™ - vn, 
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GO ON TO THE NEXT PAGE. 
-13- 
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5. For many years, the medically accepted practice of giving aid to a person experiencing a heart attack was to have 
the person who placed the emergency call administer chest compression (CC) plus standard mouth-to-mouth 
resuscitation @MMR) to the heart attack patient until the emergency response team arrived. However, some 
researchers believed that CC alone would be a more effective approach. 


In the 1990s a study was conducted in Seattle in which 518 cases were randomly assigned to treatments: 278 to 
CC plus standard MMR and 240 to CC alone. A total of 64 patients survived the heart attack: 29 in the group 


receiving CC plus standard MMR, and 35 in the group receiving CC alone. A test of significance was conducted 
on the following hypotheses. 


Hg: The survival rates for the two treatments are equal. 


H,: The treatment that uses CC alone produces a higher survival rate. 


This test resulted in a p-value of 0.0761. 


(a) Interpret what this p-value measures in the context of this study. 


7 
4 test ctadstha (in ths CASE, 2) that arene 
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the Greranrety that the deference I toe 
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were eqral, 1S ve - 
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(b) Based on this p-value and study design, what conclusion should be drawn in the context of this study? Use a 
significance level of a = 0.05. 
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GO ON TO THE NEXT PAGE. 
-12- 


© 2009 The College Board. All rights reserved. 
Visit the College Board on the Web: www.collegeboard.com. 


59d 


If you need more room for your work for part (b), use the space below. 


(c) Based on your conclusion in part (b), which type of error, Type I or Type II, could have been made? What is 
one potential consequence of this error? 
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GO ON TO THE NEXT PAGE. 
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5. For many years, the medically accepted practice of giving aid to a person experiencing a heart attack was to have 
the person who placed the emergency call administer chest compression (CC) plus standard mouth-to-mouth 


resuscitation (MMR) to the heart attack patient until the emergency response team arrived. However, some 
researchers believed that CC alone would be a more effective approach. 


In the 1990s a study was conducted in Seattle in which 518 cases were randomly assigned to treatments: 278 to 
cc plus standard MMR and 240 to CC alone. A total of 64 patients survived the heart attack: 29 in the group 
receiving CC plus standard MMR, and 35 in the group receiving CC alone. A test of significance was conducted 
on the following hypotheses. 


Ho: The survival rates for the two treatments are equal. 


H,: The treatment that uses CC alone produces a higher survival rate. 


This test resulted in a p-value of 0.0761. 


(a) Interpret what this p-value measures in the context of this study. 


This p- VALVE maasuces Are probalow ty 
of the arterenca of tna number of 
people. wn Sucwiired Nat used tna 
M0 Alfeerent +treormants. 


(b) Based on this p-value and study design, what conclusion should be drawn in the context of this study? Use a 
significance level of a = 0.05. 
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GO ON TO THE NEXT PAGE. 
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If you need more room for your work for part (b), use the space below. 


(c) Based on your conclusion in part (b), which type of error, Type I or Type I, could have been made? What is 
one potential consequence of this error? 
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GO ON TO THE NEXT PAGE. 
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Question 5 
Overview 


The primary goals of this statistical inference question were to assess a student’s ability to (1) interpret a 
p-value in context; (2) make an appropriate conclusion about the study based on the p-value; and (3) based 
on the conclusion, identify the type of error that could have occurred and a possible consequence of this 
error in context. 


Sample: 5A 
Score: 4 


The response to part (a) includes a correct probability phrase (“the probability of observing data as extreme 
as what was collected”) and a correct conditional phrase (“assuming the survival rates for the two 
treatments are equal”), stated in the context of the problem. Part (a) was scored as essentially correct. 

In part (b) the response includes a correct conclusion in context, with appropriate linkage to the p-value. 
Part (b) was scored as essentially correct. The response to part (c) names an error that is consistent with 
part (b) and provides a correct definition of that error, although the definition is not required. Part (c) 
provides a consequence, in context, that is consistent with part (b), is specific with regard to the 
treatments, and addresses how patients would be treated as a result of the error. Part (c) was scored as 
essentially correct. The entire answer, based on all three parts, was judged a complete response and 
earned a score of 4 points. 


Sample: 5B 
Score: 3 


The response to part (a) includes a correct probability phrase (“the probability of receiving a test statistic 
_.. that great or greater”) and a correct conditional phrase (“assuming the null hypothesis . . . is true”). 
However, neither of these two components is stated in the context of the problem. Consequently, part (a) 
was scored as partially correct. In part (b) the response includes a correct conclusion in context, with 
appropriate linkage to the p-value. Part (b) was scored as essentially correct. The response to part (c) 
names an error that is consistent with part (b) and provides a correct definition of that error, although the 
definition is not required. The student also provides a consequence, in context, that is consistent with part 
(b), is specific with regard to the treatments, and addresses how patients would be treated as a result of 
the error. Note that the response to part (c) includes a phrase that implies acceptance of the null 
hypothesis (“there is, according to the conclusion no difference between the treatments”). However, the 
student was not penalized for this statement because this part of the question focuses on the possible error 
made, rather than the conclusion of the test. Therefore part (c) was scored as essentially correct. With two 
parts essentially correct and one part partially correct, the entire answer was judged a substantial response 
and earned a score of 3 points. 


Sample: 5C 
Score: 2 


The response to part (a) does not include a correct probability phrase; among other problems, there are no 
phrases such as as large as or as extreme as. Neither is there a correct conditional phrase. Part (a) was 
scored as incorrect. In part (b) the response includes a correct conclusion in context; however, there is no 
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Question 5 (continued) 


linkage to the p-value. Part (b) was scored as partially correct. The response to part (c) names an error that 
is consistent with part (b) and provides a correct definition of that error, although the definition is not 
required. Part (c) provides a consequence, in context, that is consistent with part (b), is specific with 
regard to the treatments, and addresses how patients would be treated as a result of the error. Part (c) was 
scored as essentially correct. With one part essentially correct, one part partially correct, and one part 
incorrect, the entire answer was judged a developing response and earned a score of 2 points. 
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